Evaluating replicability of laboratory experiments in economics.
نویسندگان
چکیده
The replicability of some scientific findings has recently been called into question. To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs.
منابع مشابه
Investigating the Rationality of Behavioral Economics in Mental Accounting by Studying Laboratory Economics
The purpose of this study is to investigate the rationality of behavioral economics in mental accounting by studying laboratory economics. Undoubtedly, economic man, whose fundamental characteristic is rationality, is the starting point for economic analysis. In conventional economics, the premise of rationality is the cornerstone and the premise of all economic theories. However, critics of ec...
متن کاملStereotypies and other abnormal repetitive behaviors: potential impact on validity, reliability, and replicability of scientific outcomes.
Normal behavior plays a key role in facilitating homeostasis, especially by allowing the animal to control and modify its environment. Captive environments may interfere with these behavioral responses, and the resulting stress may alter many physiological parameters. Abnormal behaviors indicate that an animal is unable to adjust behaviorally to the captive environment and, hence, may be expres...
متن کاملGenotype-environment interactions in mouse behavior: a way out of the problem.
In behavior genetics, behavioral patterns of mouse genotypes, such as inbred strains, crosses, and knockouts, are characterized and compared to associate them with particular gene loci. Such genotype differences, however, are usually established in single-laboratory experiments, and questions have been raised regarding the replicability of the results in other laboratories. A recent multilabora...
متن کاملDarting behavior: a quantitative movement pattern designed for discrimination and replicability in mouse locomotor behavior.
In the open-field behavior of rodents, Software for Exploring Exploration (SEE) can be used for an explicit design of behavioral endpoints with high genotype discrimination and replicability across laboratories. This ability is demonstrated here in the development of a measure for darting behavior. The behavior of two common mouse inbred strains, C57BL/6J (B6) and DBA/2J (D2), was analyzed acro...
متن کاملThe validity, diagnostic value and replicability of Bender Visual-Motor Gestalt Test in traumatic brain injury patients
Introduction: Bender Gestalt test is one of the most famous neuropsychological tests that is simple and it can be used to examine brain injuries. The objective of this research was to investigate the validity, diagnostic strength and the replicability of the Bender Visual-Motor Gestalt Test in patients with traumatic brain injury (TBI). Methods: 240 participants were tested in a case-control st...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Science
دوره 351 6280 شماره
صفحات -
تاریخ انتشار 2016